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10 BACKGROUND OF THE INVENTION 

[00031 The present invention relates to obtaining digital panoramic images and displaying 
panoramic images on computer screens. 

i Phe — present — invention — related — in particular — fee — a — method — fese 

capturing — a digital panoramic image , comprising a step e# 

15 projecting a panorama onto an image ocnaor by means of — a fish eye 

objective — lens — having — a — constant — field — angle — relative — fee — its- 

optical axis, — the image sensor being rectangular in shape. The 

present invention also relates to a method for displaying an initial panoramic image captured in 

accordance with the above-mentioned method on a screen. 
20 r00041 Fiqurc F ig. 1 represents a classical device allowing a digital panoramic image to be 

produced and presented on a computer screen. The device comprises a digital camera 1 equipped 

with a fish-eye objective lens 2 having a constant field angle relative to its optical axis and 

preferably offering a solid image capture angle of at least 2n steradians (i.e. a field angle of at least 

180°). The camera 1 is connected to a computer 5, such as a microcomputer for example, equipped 

25 with a screen 6. The connection to the microcomputer 5 may be permanent, when, for example, the 

camera 1 is a digital video camera, or temporary, when, for example, the camera 1 is a still digital 

camera equipped with an image memory. 

[00051 Fiqurc Fig. 2 schematically represents the appearance of a panoramic image 4 
projected onto a digital image sensor 3 by means of the fish-eye objective lens 2. In accordance 
30 with the most widespread industrial standard for consumer digital cameras, the image sensor 3 is 

rectangular in shape, to produce rectangular photographs in 4/3 format (video format). The image of 
the panorama projected onto the image sensor has the shape of a disk and is characteristic of the 
axial symmetry of fish-eye objective lenses having a constant field angle relative to their optical 
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.axis. The entire image on the rectangular image sensor therefore has dark edges that will be 
removed when digitally processed subsequently. This rectangular digital image comprising the 
image disk 4 is delivered by the camera 1 in the form of a computer file containing image points 
coded RGBA arranged in a two-dimensional table, "R" being the red pixel of an image point, "G" 
5 the green pixel, "B" the blue pixel, and "A" the Alpha parameter or transparency, the parameters R, 
G, B, A generally being coded on 8 bits. 

r00061 The image file is then transferred into the microcomputer 5 which transforms the 

initial image disk 4 into a three-dimensional digital image, then presents the user with a sector of the 
three-dimensional image in a display window DW occupying all or part of the screen 6. 

10 r00071 Fiqurc F ig. 3 schematically shows classical steps of transforming the two-dimensional 
panoramic image into a panoramic image offering a realistic perspective effect. After removing the 
black edges of the image, the microcomputer has a set of image points forming an image disk 10 of 
cQntrc c enter O' and axes O'U and O'V. The image points of the image disk 10 are transferred into 
a three-dimensional space defined by an orthogonal coordinate system of axes OXYZ, the axis OZ 

15 being perpendicular to the plane of the image disk. The transfer is performed by a mathematical 
function implemented by an algorithm executed by the microcomputer, and leads to obtaining a set 
of image points referenced in the coordinate system OXYZ. These image points are for example 
coded in spherical coordinates RGB A((p,0), cp being the latitude and 9 the longitude of an image 
point, the angles (p and 0 being coded on 4 to 8 bytes (IEEE standard). These image points form a 

20 sphere portion HS covering a solid angle of at least 2n steradians relative to the contrc center O of 
the system. The microcomputer therefore has a three-dimensional virtual image one sector 1 1 of 
which, corresponding to the display window DW mentioned above, is presented on the screen (Fig. 
1) considering that the observer is on the central point O of the system of axes OXYZ, which defines 
with the ccntro center O" of the image sector 1 1, a direction 00" called "viewing direction". 

25 r00081 This technique of displaying a digital panoramic image sector on a computer screen 

has various advantages, particularly the possibility of "exploring" the panoramic image by sliding 
the image sector 1 1 presented on the screen to the left, the right, upwards or downwards, until the 
limits of the panoramic image are reached. This technique also allows complete rotations to be 
carried out inside the image when two complementary digital images have been taken and supplied 

30 to the microcomputer, the latter thus reconstituting a complete panoramic sphere by assembling two 
hemispheres. Another advantage provided by presenting a panoramic image on screen is to enable 
the observer to make enlargements or zooms on parts of the image. The zooms are performed 
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.digitally, by shrinking the image sector displayed and expanding the distribution of the image points 
on the pixels of the screen. 

r00091 Despite these various advantages, digital zooms have the disadvantage of being 

limited by the resolution of the image sensor, which is generally much lower than that of a classical 
5 photograph. Therefore, when the enlargement increases, the granulosity of the image appears as the 
limits of the resolution of the image sensor are being reached. 

fOOlOl To overcome this disadvantage, it is well known to proceed with pixel interpolations 

so as to delay the apparition of the blocks of colour color which betray the limits of the resolution 
of the sensor. However, this method only improves the appearance of the enlarged image sector and 

10 does not in any way increase the definition. Another obvious solution is to provide an image sensor 
with a high resolution, higher than the resolution required to present an image sector without 
enlargement, so that there is a remaining margin of definition for zooms. However, this solution is 
expensive as the cost price of an image sensor rapidly rises with the number of pixels per unit of 
area. Yet another classical solution involves arranging the image sensor in a plane in which the 

15 diameter of the image disk is equal to the length of the image sensor. Thus the entire surface of the 
image sensor is covered but the image projected is cut off at the top and the bottom widthwise of the 
image sensor. The disadvantage is, in this case, a reduction in the field of view. 

BRIEF SUMMARY OF THE INVENTION 
[00111 Thcrcf ore, — one general object of thc T he present invention 
20 jrs comprises methods to improve the definition offered by digital enlargements concerning certain 
parts of a digital panoramic image, without the need to increase the number of pixels per unit of area 
of an image sensor and without reducing the field of view. 

r00121 To achieve thia object, — tk eThe present invention is based on two 
premises: 

25 1) rectangular image sensors used in consumer digital cameras, particularly 4/3 

sensors, are not optimised for fish-eye image capture. As it was seen above in relation with 
Fiqurc F ig. 2, the black edges on each side of the image disk 4 occupy a substantial surface area 
and represent a significant number of wasted pixels, to the detriment of the definition and the quality 
of the digital zooms, 

30 2) in many applications such as video surveillance, videoconferencing, visio- 

conferencing, the most interesting zone of a digital panoramic image is generally situated towards 
the centre center of the image, along a horizontal line that crosses the image disk from left to right 
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.passing through its centre . center. In the field of leisure, most panoramic images also comprise 
parts that are less interesting than others, such as the parts representing the sky or a ceiling for 
example, as well as the ground, the most useful part generally being located in the vicinity of the 
ccntre center of the image, along the above-mentioned horizontal line. 

5 r00131 On the basis of these premises, the idea of the present invention io to 

provide provides an expansion of the fish-eye image projected onto a rectangular image sensor, 
by providing and using a fish-eye objective lens according to the present invention that distorts the 
images by anamorphose and stretches them sideways without reducing the field of view. Thus, this 
expansion is performed lengthwise of the image sensor, without expanding the image widthwise of 
10 the image sensor to avoid the image going beyond the sensitive surface area of the sensor. The 

central zone of the image along the above-mentioned horizontal line then covers a greater number of 
pixels of the image sensor than if it were not expanded, and has a better definition, which 
substantially improves the quality of digital zooms. 

r00141 According to another aspect of the present invention, subsequent processing of the 

15 image is provided to correct the optical distortions of the objective lens while keeping the advantage 
of a better definition, and an image sector free from distortion is presented in a display window. 
fOOlSI More particularly, the present invention relates to a method for capturing a digital 

panoramic image, comprising a step of projecting a panorama onto an image sensor by means of a 
fish-eye objective lens having a constant field angle relative to its optical axis, the image sensor 
20 being rectangular in shape, in which the fish-eye objective lens is provided to project onto the image 
sensor, without reducing the field of view, a distorted panoramic image which is not in the shape of 
a disk and which covers a number of pixels on the image sensor higher than the number of pixels 
that would be covered by a conventional image disk. 

r00161 According to one embodiment, the fish-eye objective lens has an image point 

25 distribution function that varies according to axes perpendicular to the optical axis of the objective 
lens, and which has a minimum spreading rate of the image along a first axis perpendicular to the 
optical axis- and a maximum spreading rate of the image along at least a second axis perpendicular 
to the optical axis, such that the image projected onto the image sensor is expanded along the second 
axis. 

30 r00171 According to one embodiment, the first and the second axes of the objective lens are 

perpendicular and the image projected by the objective lens onto the image sensor is ellipsoidal in 
shape. 
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J00181 According to one embodiment, the image sensor is arranged relative to the first and 

second axes of the objective lens so that the major axis of the ellipsoidal image coincides with an 
effective length of the image sensor. 

r00191 According to one embodiment, the image sensor is arranged relative to the first and 

5 second axes of the objective lens so that the major axis of the ellipsoidal image coincides with a 
diagonal of the image sensor. 

r00201 According to one embodiment, the objective lens has a distribution function that is 

not linear and that has a maximum divergence of at least ±10% compared to a linear distribution 
function, such that the projected image has at least one substantially expanded zone and at least one 
10 substantially compressed zone. 

r00211 According to one embodiment, the fish-eye objective lens comprises a combination 

of a group of lenses provided to capture a panoramic image according to a determined field angle, 
and of at least one cylindrical lens having an axis of revolution perpendicular to the optical axis of 
the objective lens. 

15 [00221 The present invention also relates to a method for displaying on a screen an initial 

panoramic image captured in accordance with the method according to the present invention, 
comprising a step of correcting the distortions of the initial image. 

r00231 According to one embodiment, the correction step comprises transforming the initial 

image into a corrected digital image in the shape of a disk, the diameter of the corrected image being 
20 chosen so that the corrected image comprises a number of image points higher than the number of 
pixels of the image sensor covered by the initial image. 

[00241 According to one embodiment, the initial image is ellipsoidal in shape and the 

corrected image has a diameter the size in number of pixels of which is at least equal to the size in 
number of pixels of the major axis of the initial ellipsoidal image. 

25 r00251 According to one embodiment, the method comprises a atop of projecting^ onto 

the initial image, image points of an image sector to be presented on the screen, allowing the 
coloura colors of the image points of the image sector to be presented on the screen to be 
determined, the step of projecting the image points of the image sector onto the initial image being 
performed by means of a distribution function representative of the optical properties of the fish-eye 

30 objective lens, such that the step of correcting the distortions of the initial image is implicit in the 
projection step. 
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J00261 According to one embodiment, the projection step comprises a first step of projecting 

the image points of the image sector onto a sphere portion— and a second step of projecting, onto the 
initial image, the image points projected onto the sphere portion. 

r00271 The present invention also relates to a computer program product recorded on a 

5 medium and loadable into the memory of a digital computer, comprising program codes executable 
by the computer, arranged to execute the steps of the display method according to the present 
invention. 

[00281 The present invention also relates to a fish-eye objective lens having a constant field 

angle relative to its optical axis, comprising optical means for projecting the image of a panorama 

10 onto an image sensor, and optical means for projecting, without reducing the field of view, a 

distorted image that is not in the shape of a disk and which covers a number of pixels on an image 
sensor higher than the number of pixels that would be covered by a conventional image disk. 
[00291 According to one embodiment, the objective lens has an image point distribution 

function that varies according to axes perpendicular to the optical axis of the objective lens, and 

15 which has a minimum spreading rate of the image along a first axis perpendicular to the optical axis, 
and a maximum spreading rate of the image along at least a second axis perpendicular to the optical 
axis, such that an image delivered by the objective lens is expanded along the second axis. 
r00301 According to one embodiment, the objective lens has a distribution function that is 

not linear and that has a maximum divergence of at least ±10% compared to a linear distribution 

20 function, such that an image delivered by the objective lens has at least one substantially expanded 
zone and at least one substantially compressed zone. 

r00311 According to one embodiment, the objective lens comprises a combination of a group 

of lenses provided to capture a panoramic image according to a determined field angle— and e-i— at 
least one cylindrical lens having an axis of revolution perpendicular to the optical axis of the 
25 objective lens. 

r00321 According to one embodiment, the objective lens comprises optical means forming 

an apodizer. 

[00331 According to one embodiment, the optical means forming an apodizer comprise at 

least one a ophc r i c a 1 aspherical lens. 
30 r00341 According to one embodiment, the objective lens comprises at least one distorting 

mirror. 

[0035] According to one embodiment, the objective lens is of the panoramic adapter type 
and is provided to be placed in front of a still camera non-panoramic objective lens. 



•= These — — other — objects, f caturco — a**d — advantages — e£ — fefee 

present — invention — shall — he — explained — ift — greater — detail — ±& — fehe 
following — description — &€ — the — method — according — fee — fefee — present 
invention — a**d — — aft — example — — as — embodiment — &£ — a — fish eye 

5 objective — lens — according — fee — fehe — present — invention, given — ±& 

relation with, — but not limited to the following figures: 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS 
F00361 — Fiqurc Fig. 1 described above represents a classical system for displaying a digital 
panoramic image on a screen— I 
10 r00371 — Fiqurc F ig. 2 described above represents a fish-eye type panoramic image 
projected onto a rectangular image sensor—; 

r00381 — Fiqurc F ig. 3 described above shows a classical method for transforming a two- 
dimensional panoramic image into a three-dimensional digital panoramic image—; 
[00391 — Fiqurc F ig. 4 is a schematic cross-section of a panoramic image capture system 

15 comprising a fish-eye objective lens according to the present invention-?— ; 

r00401 — Fiqureo F igs. 5 A- — &&r^ 5C represent optical properties of a fish-eye objective 
lens used to implement the image capture method according to the present invention^; 
r00411 — Fiqurc F ig. 6 represents a system for displaying a digital panoramic image-; 
[00421 — Fiqureo Figs. 7 A aaadr 7B show a first method for correcting a panoramic image 

20 according to the present invention-r; 

F0043] — Fiqurc F ig. 8 is a flow chart describing a method for displaying a panoramic image 
incorporating the first correction method—; 

[00441 — Fiqurc F ig. 9 shows a second method for correcting a panoramic image according 
to the present invention-^; 
25 r00451 — Fiqurc F ig. 10 is a flow chart describing a method for displaying a panoramic 
image incorporating the second correction method-; 

[0046] — Fiqurc Fig. 1 1 shows by a cross-section an example of an embodiment of a fish- 
eye objective lens according to the present invention-r; 

r00471 — Fiqurc Fig. 12 is an exploded cross-section of a system of lenses present in the 
30 objective lens in Figure 11, F ig. 11; 

r00481 — Fiqurc Fig. 13 shows one alternative of the panoramic image capture method 
according to the present invention , and; 
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J0Q491 — Ficrurco F igs. 14A and - 14B show another alternative of the panoramic image 
capture method according to the present invention—; and 

[00501 — Fiqurco F igs. 15 A and. 15B show yet another alternative of the panoramic image 
capture method according to the present invention. 

5 DETAILED DESCRIPTION OF THE INVENTION 

rOOSll Description of a panoramic image capture method according to the present 
invention 

r00521 I - Distortion of w initial image 

r00531 Description of a panoramic image capture method according 

10 to the present inv e ntion 

1 - Dist ortio n of an initial image 

Figuro F ig. 4 schematically represents, by a cross-section, a panoramic image capture 

system comprising a fish-eye objective lens 15 according to the present invention having a constant 
field angle relative to its optical axis OZ, and a rectangular image sensor 16 arranged in the image 

15 plane of the objective lens 15. 

f00541 Seen in the planigraphic plane in Fiqurc Fig. 4, the properties of the fish-eye 

objective lens 15 conform to those of a classical objective lens and are characterised by a 
determined angular distribution function Fd. As an example two object points a, b will be 
considered belonging to a panorama PM and respectively having field angles ccl, a2. 

20 Conventionally, the field angle of an object point is the angle that an incident light ray passing 

through the object point considered and through the ccntrc center of the panorama PM, marked by 
a point "p", has relative to the optical axis OZ. On the sensor 16, image points a', b' corresponding 
to the object points a, b are located at distances d(a'), d(b') from the ccntrc center of the image that 
are linked to the angles ocl, cc2 by the following relations: 

25 (1) d(a*) = Fd (ccl) 

(2) d(b') = Fd(oc2) 

[00551 Fd being the distribution function of the image points relative to the field angle of the 
object points. 

[00561 The objective lens 15 according to the present invention differs from a classical 

30 objective lens by the fact that the distribution function Fd varies according to the position of the 
object points in a plane perpendicular to the optical axis OZ. This will be better understood with 
reference to Fiqurco F igs. 5A, 5B and 5C that show the properties of this objective lens. 
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[00571 Figurc F ig. 5 A represents the panorama PM in the form of a circle, the optical axis 
OZ here being perpendicular to the plane of the Figure. F ig. The objective lens has two axes XI, 
X2 located in a plane PL perpendicular to the optical axis OZ (i.e. parallel or merged with the plane 
of the sheet), each of the two axes XI, X2 passing through the optical axis OZ. The angular 
5 deviation between the two axes XI, X2 is designated and is preferably equal to 90°. According 
to the present invention, the objective lens has a distribution function Fd[Xl] along the axis XI and 
a distribution function Fd[X2] along the axis X2. The functions Fd[Xl] and Fd[X2] are different, 
the function Fd[Xl] being the one that has a lower spreading rate of the image and the function 
Fd[X2] the one that has a higher spreading rate of the image. 

10 r00581 For a better understanding, two pairs of object points al, bl and a2, b2 will be 

considered respectively arranged along the axis XI and the axis X2, the points al and a2 having the 
same field angle al and the points bl and b2 the same field angle cc2 relative to the optical axis OZ 
(Cf. Figure Fig. 4). Figure Fig. 5B represents the projection of these points onto the 
rectangular image sensor 16. The objective lens is arranged relative to the image sensor 16 so that 

15 the axis with the lower spreading XI coincides with the width of the sensor and the axis with the 
higher spreading X2 coincides with the length of the sensor. The axis X2 preferably corresponds to 
the horizontal axis of a shot taken and the axis XI corresponds to the vertical axis. On the projected 
image, represented in Fig. 5B, image points al', bl* along the axis XI and image points a2', b2' 
along the axis X2 can be distinguished. The point al' is at a distance d(al') = F[Xl](al) from the 

20 contre center of the image, the point bl' is at a distance d(bl') = F[Xl](cc2) from the 
centrc center of the image, the point a2 f is at a distance d(a2') = F[X2](al) from the 
centrc center of the image and the point b2' is at a distance d(b2') = F[X2](o2) from the 
centre center of the image. With a classical fish-eye objective lens, the distance d(a2') would be 
equal to the distance d(al') as the object points al, a2 have the same field angle al. Similarly, the 

25 distance d(b2') would be equal to the distance d(bT) as the object points bl, b2 have the same field 
angle a2. With the fish-eye objective lens according to the present invention, the distance d(b2') is 
greater than the distance d(bl') and the distance d(a2') is greater than the distance d(al'). 
r00591 Preferably, the function Fd[Xl] is chosen so that the image points present along the 

axis XI occupy the whole effective width lc of the sensor. Similarly, the function Fd[X2] is chosen 

30 so that the image points present along the axis X2 occupy the whole effective length Lc of the 
sensor. Thus, if the field angles of the object points bl, b2 are equal to 90°, as represented in 
Figurca F igs. 4 and 5 A, and if the angular aperture of the objective lens is 180°, the distances 
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t d(br), d(b2') relative to the CGntrc center of the image of the image points bl\ b2' are respectively 
equal to lc/2 and Lc/2 (Fig. 5B). 

r00601 In addition to the axes XI and X2, the objective lens according to the present 

invention has an infinity of intermediate axes Xi along which the objective lens has distribution 
5 functions Fd[Xi] having a determined spreading rate higher than the minimum spreading rate. As an 
example, an axis Xi that has an angle \|/i relative to the axis XI, with \|/i lower than and two 
object points ai, bi situated along the axis Xi and having field angles ccl, a2 (Fig. 5 A) will be 
considered. The corresponding image points ai', bi' on the sensor 16 (Fig. 5B) are located at 
distances d(ai f ) = F[Xi](al) and d(bi') = F[Xi](cx2) relative to the ccntrc center of the image. The 

10 distances d(ai') and d(bi') are respectively greater than d(ar) and d(bl f ). 

r00611 Therefore, the distribution function Fd of a fish-eye objective lens according to the 

present invention varies according to the axis along which the object points are located, in a plane 
perpendicular to the optical axis OZ, and has a minimum spreading rate along the axis XI and a 
maximum spreading rate along at least a second axis, i.e. the axis X2 in the example described 

15 above. 

r00621 Below in relation with Fiqurcs Figs. 1 1 and 12 12, an embodiment of an 

objective lens according to the present invention will be described which delivers an ellipsoidal 
image, by using a toroidal lens having an axis of revolution parallel to the optical axis, equivalent to 
a cylindrical lens having an axis of revolution perpendicular to the optical axis. On Fiqurc F ig. 

20 5B, the image point ai' is then located on an ellipse passing through the points al' and a2' and the 
image point bi 1 is located on an ellipse passing through the points bl 1 and b2\ 
r00631 Moreover, again according to the embodiment described below in relation with 

FicfurG3 F igs. 11 and 12, the function Fd is linear along each axis Xi of the objective lens, such 
that the distance d(ai') in relation to the CGntrc center of the image of an image point ai 1 obeys the 

25 following relation: 

(3) d(ai') = Ki ai 

in which ai is the field angle of the corresponding object point ai, and Ki a distribution constant 
which varies according to the axis Xi along which the object point is located. 
r00641 For a better understanding, examples of distribution functions Fd[Xi] of an objective 

30 lens according to the present invention are represented in curve form in Ficrurc F ig. 5C, on a graph 
comprising relative distances dr on the Y-axis and field angles a on the X-axis. The relative 
distance dr of an image point is the distance of the image point in relation to the CGntrc center of 
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.the image divided by the greatest distance relative to the Gcntrc center of the image of an image 
point situated on the axis XL In the case of an ellipsoidal image, this greatest distance along the 
axis XI is the half-length Dl/2 of the minor axis of the ellipsoid. 

[00651 On Ficrurc F ig. 5C three curves can be distinguished that correspond to the three 

5 distribution functions Fd[Xl], Fd[X2], Fd[Xi]. In this example, these distribution functions are 
linear and are thus in the form of straight lines, of respective gradients Kl, K2 and Ki. The gradient 
Kl is equal to 1/90° for an objective lens having an angular aperture of 180°, the gradient K2 is 
greater than Kl and the gradient Ki is between Kl and K2. As indicated above, the gradient K2 is 
preferably equal to Kl*Lc/lc so that the image covers the whole effective length Lc of the image 
10 sensor. 

[00661 In the description below, the other aspects of the present invention will be described 

considering the case of a projection of an ellipsoidal image onto the image sensor. This ellipsoidal 
image will be designated an "image ellipsoid" while the classical image in the shape of a disk will be 
called an "image disk", in accordance with the usual terminology. 

15 r00671 The advantage of the method according to the present invention is that the surface 

covered by the projected image is greater than the one covered by an image disk, without reducing 
the field of view, such that the number of pixels covered by the image is higher. The gain in 
definition obtained using the present invention, expressed in a ratio of pixels, is easy to calculate in 
the case of an ellipsoidal image. On the surface area of the image sensor, the image ellipsoid covers 

20 a number of pixels NP equal to: 

(4) NP = 7i(Dl/2)*(D2/2)*Np 
Np being the number of pixels of the sensor per unit of area, D2 being the major axis and Dl the 
minor axis of the ellipsoidal image (it shall be noted here that Dl is imposed by the effective width 
lc of the sensor and that D2 can, at the most, be equal to the effective length Lc of the sensor). 

25 r00681 In comparison, the number of pixels NP 1 covered by an image disk is: 

(5) NP' = 7i(Dl 2 /4)*Np 
Dl being the diameter of the image, imposed by the width of the sensor. 

r00691 By combining the relations (4) and (5), the percentage G% of pixels gained between 

an image ellipsoid and an image disk is equal to: 
30 (6) G% = (D1/D2 - 1)*100 

r00701 The number of pixels that image sensors of consumer digital cameras currently 

comprise is in the order of 2 million pixels, i.e. 1600x1200 pixels, the 4/3 ratio corresponding to the 
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.standard of the consumer digital photography market. An objective lens according to the present 
invention performing an ellipsoidal projection offers, in these conditions, a 33% gain in number of 
pixels covered, which represents a significant gain in definition along the axis X2 and in the parts of 
the image located in the vicinity of the axis X2. 
5 r00711 This gain is even higher when the method according to the present invention is 

implemented with a conventional camera using a film having a length to width ratio of 3/2 (format 
24*36 of commercial films). The photograph taken is then digitised with a scanner having a 
determined definition. After digitisation, the gain in number of pixels covered (at constant 
definition during the digitisation) is then of 50%. 

10 r00721 It will thus be noted here that the method according to the present invention is 

applicable both to digital photography techniques using digital image sensors and to digital 
photography techniques comprising a step of taking a conventional photograph followed by a step of 
di cri t i o inq digitizing the photograph by means of a scanner. Therefore, in the present 
application, the term "digital image sensor" designates both a digital image sensor and a 

15 conventional photographic film combined with a digitisation device such as a scanner. 
r00731 II - Correction of the distortions of the initial image 

r00741 Corr e ction of tho distortion s of tho initial imag e 

A first aspect of the present invention was described above, according to which an 
expansion of an image projected onto an image sensor was provided in order to improve the 

20 definition of the image in expanded zones, by increasing the number of pixels of the image sensor 
covered by the expanded zones. Before describing an example of an embodiment of a fish-eye 
objective lens according to the present invention, a second aspect of the present invention will be 
described which involves correcting the distortions of the initial image so as to present the observer 
with an image free from optical distortion. As indicated above, the description of this aspect of the 

25 present invention will be given with reference to an image ellipsoid. 

[00751 This second aspect of the present invention is implemented at the stage of the 

processing of the initial image by computer, to present an interactive panoramic image on a screen. 
The means for implementing the method of the present invention are shown in Fiqurc Fig. 6 and 
are classical per se as far as their general arrangement is concerned. A digital camera 20 can be 

30 distinguished equipped with a fish-eye objective lens 21, here an objective lens according to the 
present invention, connected to a microcomputer 22 comprising a screen 23. Digital images Mi 
taken by means of the camera 20 are transferred to the microcomputer to be processed and displayed 
on the screen 23, in a display window DW. A processing program according to the present 
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.invention, comprising an algorithm for transforming and displaying the images is first loaded into 
the microcomputer, by means of a CD-ROM 25 or by downloading via the Internet for example. 
The camera 20 can be a still digital camera or a digital video camera and the connection to the 
microcomputer can be permanent or otherwise. In the case of a video camera, the microcomputer 
5 receives a flow of images that it processes in real time to display them on the screen. In thio 
context, — the present invention provides two ways of correcting the 
distortions of the initial image. According to a first embodiment, 
the image ellipsoid is corrected so as to obtain a classical image 
disk. The corrected image disk is equivalent to an image disk 

10 produced by a classical fish eye objective lens and can then be 
processed by any classical display software program available in 
stores, — provided for transferr i n g the image points of an image disk 
into a three dimensional space and for interactively displaying a 
sector of the three dimensional image on a screen. — According to a 

15 second embodiment, — the image is corrected in real time at the time 
the image points constituting the image sector to be presented in 
the display window DW arc determined, — by using the angular 
di s tribution function Fd of the objective lens. First embodiment 
of th e correction method Figures 7A and 7B show the first 

20 embodiment of the method according to the present invention. — Here 
it is assumed that there is an initial image Imgl comprising an 
image ellipsoid IDl of minor axis Dl and of major axis D2 — (Fig. 
7A) . The initial image Imgl is transformed into a corrected image 
Img2 comprising an image disk ID2 of radius D3 — (Fig. — 7B) . The 

25 radius D3 of the image disk ID2 is preferably equal to the major 
axis D2 of the image ellipsoid IDl, — such that the image disk ID2 
has a resolution equal or substantially equal to the resolution 
offered by the most stretched out zone of the image ellipsoid IDl, 
where the greatest density of information is to be found. Here it 

30 is the central part of the image located in the vicinity of the 
major axis D2 . 

r00761 In this context, the present in vention provides two wavs of correcting the distortions of 
the initial image. According to a first e mbodiment, the image ellipsoid is corrected so as to obtain a 
classical image disk. The corrected image disk is equivalent to an ima ge disk produced _bvj 
35 classical f ish-eve objective lens and can then be processed b v any clas sical display software 

pro gram available in stores, p rovided for t ransferring the image points of an image disk i nto a three- 
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. dimensional space and for interacti vely displaying a sector of the three-dimensional image on a 
screen. According to a second e mbodiment, the imag e is corrected in re al time at t he time th ejymage 
points constituting the im age sector to bepresented in the display wi ndow DW are determined, by 
using the angular distri bution fu nction Fd of the objec tive lens. 
5 f00771 First embodiment of the correction method 

r00781 Figs. 7 A and 7B show the first embodiment of the method according to the present 
invention. Here it is assumed that there is an initial image Imgl comprising an image ellipsoid ID1 
of minor axis Dl and of maior axis D2 (Fig. 7 A). The initial image Imgl is transformed into a 
corrected ima ge Img2 c omprising an image disk ID2 of radius D3 (Fi g. 7B). The radius D3 of the 

10 image disk ID2 is preferably equal to themaior axis D2 of the image ellipsoid 1DL such that the 
image disk ID2 has a res olution equal or sub stantially equal to the resolution offered by the most 
stretched out zone of the ima ge ellipsoid IDL where the greatest density of information is to be 
found. Here it is the central part of the im age located in the vicinity of the maj or axis D2. 
r00791 This method therefore involves stretching the image vertically in a proportion of 

15 (D2/D1)*100 percent. It can be implemented by means of the algorithm 1 described below as an 
example, in which: 

— Imgl is the initial image comprising the image ellipsoid DDI, 

— Img2 is the image generated by algorithm 1, comprising a classical image disk ID2, 

— a is the half-length of the minor axis of the image ellipsoid ID1, expressed in number 

20 of pixels, i.e. a = Dl/2*Npl, Npl being the number of pixels per unit of length of the image sensor 
used, 

— b is the half-length of the major axis of the image ellipsoid DDI, expressed in number 
of pixels, i.e. b = D2/2*Npl, 

— b is also the radius of the image disk ED2, expressed in number of pixels, 
25 — "O" designates the ccntrc center of the initial image Imgl as well as the 

ccntrc center of the image generated Img2, 

— i and j are the coordinates of an image point Img2[i,j] in the image Img2, i designating 
the columns, j the lines, the coordinate point (0,0) being in the ccntrc center of the image, 

— r is the distance in relation to the ccntrc center of the image of an image point in the 
30 image Img2, 

— "u M and "v" are the coordinates of an image point Imgl[u,v] in the initial image Imgl, 
"u" designating the columns, "v M the lines, the coordinate point (0,0) being in the ccntrc center of 
the image, 
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— [OU) is a reference axis of direction U having its origin in O, 
— [OP] is a straight line segment having a point of origin in O and an end point in P, P 
being an image point of coordinates (u,v), 

— 9 is an angle between the axis [OU) and a segment [OP], 
5 "V" is the square root function. 

"arc cos" is the inverse function of the cosine function. 
ALGORITHM 1 
1/ For i = -b to +b 
21 Forj = -bto+b 

10 3/ r = V(i*i+j*j) 

4/ If (r<b)then 

5/ If j<0 then 

6/ 9 = arc cos(i/r) 

II If not 

15 8/ 6 = -arc cos(i/r) 

91 End if 

10/ u = r*cos(0) 

11/ v = (a/b)*r*sin(0) 

12/ Img2[i,j]=Imgl[u,v] 
20 13/ End if 

14/ End for 
15/ End for 

r00801 In practice, the algorithm 1 can be improved by subsequently performing a bilinear 

interpolation on the image Img2, in itself well known by those skilled in the art, so as to smooth out 
25 the final image. 

r00811 Fiqurc F ig. 8 is a flow chart giving a general overview of the steps of a method for 
capturing and interactively presenting a panoramic image on a screen. This flow chart is described 
in tablc Table 1 in the Appendix, that is an integral part of the description. The steps SI and S2, 
respectively the acquisition of the image and the transfer of the image into a computer, are classical 
30 in themselves and differ from previous practices by the fact that the captured image is ellipsoidal in 
shape. The step S3 of correcting the image ellipsoid ID1 is executed in accordance with the method 
of the present invention, by means of the algorithm described above for example. The step S4, 
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palled "digitisation", is also classical. This step involves transferring the image points of the image 
disk ID2 into a three-dimensional space of axes OXYZ in which the image points are for example 
referenced in spherical coordinates. The step S5 is also classical and involves presenting a sector of 
the image in the display window DW. The display window is moved upwards or downwards 
5 depending on the user's actions, or is enlarged at the user's request. When enlarged, the definition 
is better than in previous practices in the zones corresponding to the expanded parts of the initial 
image. 

f00821 Second embodiment of the correction method 

r00831 The second embodiment of the correction method according to the present invention 

10 is shown in Fiemrc F ig. 9. Very schematically, this method involves projecting the image points of 

an image sector IS to be presented in the display window DW (Fig. 6) onto the image ellipsoid ID1 

of the initial image Imgl. This method does not require calculating a corrected image disk. 

r00841 The image points of the image sector IS to be displayed in the window DW are 

referenced E(i,j) in the coordinate system of the image sector IS, that is expressed in line coordinates 
15 i and in column coordinates j. The points E(i,j) are first projected onto a sphere portion HS of 

cGntrc center O and of radius R in a coordinate system of origin O and of axes OX, OY, OZ, to 

obtain image points P(px,py,pz) belonging to the sphere portion. 

[00851 Out of concern to remain simple, it will be considered that the fish-eye objective lens 

that is used here has an angular aperture of 180°. The sphere portion HS is in this case a 

20 hemisphere. The image sector IS moves tangentially to this hemisphere. 

[00861 The image points P(px,py,pz) determined on the hemisphere HS are then projected 

onto the image ellipsoid ID1 by means of the distribution function Fd of the fish-eye objective lens, 
which first requires calculating the field angle a of the points P in relation to the ccntrc center O 
of the hemisphere, the CGntrc center O being the virtual equivalent of the ccntrc center "p" of the 

25 panorama at the time the image is captured. The projection of the image points P(px,py,pz) onto the 
hemisphere HS allows image points P'(pu,pv) to be obtained on the image ellipsoid, in a coordinate 
system of ccntrc center O' corresponding to the ccntrc center of the image ellipsoid and of axes 
O'U and O'V. The axis OZ in the system of the hemisphere is perpendicular to the plane of the 
image ellipsoid DDI and passes through the ccntrc center O', such that the axes O'Z and OZ are 

30 merged. 

f00871 As it will be clear to those skilled in the art, the correction of the distortions of the 

image is implicit here since the image points P'(pu,pv) corresponding to the image points E(i, j) of 
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.the image sector IS are "retrieved" from the image ellipsoid ID1, by means of the distribution 
function Fd. 

r00881 The method according to the present invention is implemented by means of the 

algorithm 2 described below, in which: 
5 - i and j are the coordinates of a point E(i, j) of the image sector IS, 

— Imax and Jmax are the number of columns and the number of lines of the image sector 

IS, 

— Ex, Ey and Ez are the Cartesian coordinates of a point E(i,j) of the image sector IS in 
the coordinate system OXYZ, 
10 — px, py and pz are the Cartesian coordinates of a point P(px,py,pz) on the hemisphere 

HS, 

— pu and pv are the Cartesian coordinates of an image point P'(pu,pv) of the image 
ellipsoid in the coordinate system O'UV, 

— LI is the size of the half minor axis of the image ellipsoid, expressed in number of 
15 pixels (LI =Dl/2*Npl), 

— L2 is the size of the half major axis of the image ellipsoid, in number of pixels (LI = 
D2/2*Npl), 

— M is the ccntrc center of the image sector IS, 

— the "viewing direction" is the direction material ioc d materialized by the point O 
20 and the ccntrc center M of the image sector IS, the image sector forming the base of a pyramid of 
vision of the observer the top of which is the point O (observer's position), 

— 00 and (p0 are the longitude and latitude of the viewing direction, 

— Screen_Pixel[i,j] is the colour color (RGBA) of a point E (ij) of the image sector 

IS, 

25 — Image_Pixel[pu,pv] is the colour color of a point P'(pu,pv) of the image ellipsoid 
ID1, 

— R is the radius of the hemisphere HS used as reference for the tangential sliding of the 
image sector IS, R having an arbitrary value chosen so as to improve the accuracy of the 
calculations, such as 10,000 for example, 
30 — a is the angle in relation to the ccntrc center O of an image point P(px,py,pz) 
(represents the field angle at the time the shot is taken of the corresponding object point), 

— auxl, aux2 are intermediate variables, 
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— "Zoom" is a variable defining the enlargement, having a default value equal to R, and 
— "V" is the square root function. 
ALGORITHM 2 
1/ For i=-Imax/2 to i=Imax/2 do /fry increments ofl] 
5 2/ For j=-Jmax/2 to j=Jmax/2 do [by increments ofl] 

[calculation of the Cartesian coordinates Ex, Ey, Ez of the point E of the image sector in the 
coordinate system (OXYZ)] 
3/ Ey = j *cos((pO) - Zoom*sin(<pO) 

4/ Ez = Zoom*cos(<pO) + j*sin((pO) 

10 5/ auxl = Ez 

61 Ez = Ez*cos(0O) - i*sin(0O) 

II Ex = i*cos(90) + aux 1 *sin(90) 

[calculation of the coordinates of a point P corresponding to the point E] 
8/ aux2 = R/V(Ex*Ex + Ey*Ey + Ez*Ez) 

15 9/ px = Ex*aux2 

10/ py = Ey*aux2 

11/ pz = Ez*aux2 

[calculation of the coordinates of a point P'(pu,pv) corresponding to the point P(px,py,pz)J 

III X = px/R 
20 13/ Y = py/R 

14/ r = V(X*X + Y* Y) 

15/ a = arc sine(r) [angle in relation to the ccntr cc enterl 

16/ U = X/r 

17/ V = Y/r 

25 18/ pu = Ll*U*Fd(cc) 

19/ pv = L2*V*Fd(tx) 

[allocation of the colou r color of the point P'(pu.pv) to the point E(i,j) of the image sector] 
20/ Screen_Pixel[i,j] = Image_Pixel[pu,pv] 

21/ end for 
30 22/ end for 

r00891 It will be noted that the function Fd used here in steps 18 and 19 is not a function 

Fd[Xi] that depends on the axis Xi considered but is the function Fd[Xl] along the axis XI. Indeed, 



,the choice has been made here to simplify the algorithm so as not to take into account the angle 
which is made possible by the ellipsoidal shape of the image DDL The adaptation of the steps 18 
and 19 to the ellipsoidal shape of the image is ensured by the parameters LI and L2. If the function 
Fd[Xl] is linear, each value of Fd(a) is calculable during the steps 18 and 19 by means of the 
5 following relation: 

Fd(a) = Fd[Xl](a) = Kl*cc 
with Kl = 27i/a 

f00901 A request for enlargement (zoom) by the user results in the algorithm modifying the 

"Zoom" parameter. When the "Zoom" parameter is equal to the radius R of the hemisphere, no 

10 zoom is performed. When the "Zoom" parameter is higher than R, the window DW moves away 
from the hemisphere HS (along the axis given by the viewing direction 0M), which corresponds to a 
shrinking of the pyramid of vision and thus an enlargement of the image sector presented in the 
window DW. The enlargement of the image sector presented to the observer is therefore equal to 
the ratio of the "Zoom" and R parameters. 

15 r00911 When the algorithm is executed with a "Zoom" parameter higher than R, a gain in 

definition is obtained in the zones in which the image has been expanded at the time the shot is 
taken as there are still, while the resolution limit is not reached, two image points on the image 
ellipsoid ID1 which correspond to two adjacent pixels of the image sector. In the non-expanded 
zones of the image, the search for the closest pixel by means of the relations Ll*U*Fd(a) and 

20 L2*V*Fd(a) results, on the other hand, in the algorithm finding the same image point for several 
adjacent pixels of the image sector IS on the image ellipsoid ID1. However, these non-expanded 
image zones benefiting from a lesser definition on the image ellipsoid, equivalent to that obtained 
with a classical fish-eye objective lens, are considered secondary for the intended application, in 
accordance with the premise on which the present invention is based. 

25 r00921 Generally speaking, it will be clear to those skilled in the art that other projection 

methods can be provided, it being essential to find the field angle a of the object points on the 
hemisphere HS, in relation to the ccntrG center O, so as to use the distribution function Fd in the 
calculations. 

r00931 It will be understood that the algorithm 2 is applicable when there are two 

30 complementary image ellipsoids, one corresponding to a front photograph and the other to a rear 

photograph of a panorama, the second photograph being taken by rotating the fish-eye objective lens 
according to the present invention by 180° around an axis passing through the contrQ center of the 
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.panorama. In this case, two complementary hemispheres and two image points called 
"FrontJmage^Pixel" and "Rear_Image_Pixer are defined. The steps 18 and following of the 
algorithm are thus modified as follows: 



18V pu = Ll*U*Fd(cc) 

5 19V pv = L2*V*Fd(a) 

20V If pz>=0then 

21V Screen_Pixel[i j] = Front__Image_Pixel[pu,pv] 

22V If not 

23V Screen_Pixel[i j] = Rear_Image_Pixel[Ll-pu,pv] 

10 24V End if 
25V end for 
26Vend for 

r00941 Fiqurc Fig. 10 is a flow chart giving a general overview of the steps of a method for 



capturing and interactively presenting a panoramic image on a screen. This flow chart is described 
15 in tablc T able 2 in the Appendix, that is an integral part of the description. The acquisition SI and 
transfer S2 steps described above are again included. The step S2 is followed by an interactive 
display step S3 1 performed in accordance with the method that has just been described, implicitly 
incorporating a correction of the distortions of the image ellipsoid through the use of the distribution 
function Fd of the objective lens to find the points corresponding to the pixels of the image sector on 
20 the image ellipsoid. 

[00951 III - Example of an embodiment of a fish-eye objective lens according to the 

present invention 

r00961 The design of an ellipsoidal projection fish-eye objective lens is based here on the 

use of cylindrical lenses. This type of lens is already known per se and used in cinema to obtain 
25 lenses of cinemascope format. This type of lens is also used in compact disk players to position the 
laser beam on the surface of a compact disk with great precision. 

r00971 As part of the present invention, cylindrical lenses (also called toroidal lenses when 

the radius of curvature is infinite) are used to increase the resolution lengthwise of the image sensor, 
in combination with lenses performing fish-eye type image capture. The intended technical effect 
30 can be obtained using one or more cylindrical lenses placed at one end of a group of lenses 

equivalent to a fish-eye objective lens, the image being stretched along the perpendicular of the axis 
of the cylinder. 
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J00981 One particular embodiment of an objective lens according to the present invention is 

described below as an example without limitation. 

[00991 Fiqurc F ig. 1 1 is a cross-section of a fish-eye objective lens 30 according to the 
present invention. The objective lens 30 is here of the panoramic adapter type ("pano-converter") 
5 and is designed to be mounted onto the front lens of a still camera. It also relates to consumer 
cameras of the non-SLR (non Reflex) type comprising a 35 mm fixed objective lens. 
rOlOQI The objective lens 30 comprises, in the direction from the input of the light rays (left 

of the Fiqurc F ig. 11) towards the output of the light rays, eight lenses LI to L8. The lens LI is 
an a sphcrical aspherical lens in acrylic of divergent meniscus type, the front of which is 

10 convex and the back concave. The lens L2 is a spherical lens in acrylic of convergent meniscus 
type, the front of which is concave and the back convex. The lens L3 is an ar- 
qphcrical aspherical lens in acrylic of biconvex type. The lens L4 is an a— 
spherical aspheric al and diffractive lens (asphero-diffractive) of convergent meniscus type the 
front of which is convex and the back concave, the back comprising a diffraction grating. The lens 

15 L5 is an a sphcrical aspherical lens in acrylic of the convergent meniscus type, the front of 
which is concave and the back convex. The lens L6 is a plano-convex spherical lens in BK7 
(borosilicate or standard mineral glass used in optics), the front of which is convex. 
rOlOll According to the present invention, the lenses L7 and L8 are cylindrical lenses 

having an axis of revolution perpendicular to the optical axis. To those skilled in the art, these 

20 lenses are the equivalent of a torus portion of infinite radius having an axis of revolution parallel to 
the optical axis. The lens L7 is a planoconcave cylindrical lens in BK7 the back of which is concave 
(the concavity is not shown on Fiquro F ig. 1 1 due to its low value). The lens L8 is a cylindrical 
lens of planoconvex type in BK7, having its front convex — (oamc remark) . 
F01021 Very ochcmatically Schematically , the lens LI allows a panoramic image to be 

25 captured according to a desired field angle, here a field angle of 185°. The back of the lens L2 

corresponds to a pupil, and forms the main diaphragm of the optical system. The lens L4 is a field 
lens which contributes to the pupillary imaging. The diffractive surface that this lens has, in 
addition to its dioptric function, causes a phase shift of the light wave complying with a polynomial 
law of the radius of aperture. The lenses L8 and L7 perform the ellipsoidal distortion sought. The 

30 other lenses have no special role, but they contribute to obtaining the final result and to the overall 
performances of the objective lens according to the present invention. 

r01031 A detailed embodiment of the panoramic adapter lens 30 is described by the table 3 

in the Appendix, that is an integral part of the description. The table 3 describes the properties of 
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each surface with reference to Ficrarc F ig. 12, which is an exploded view of the lens system. On 
this Ficrurc F ig. , the front and back of the lens LI are referenced Sll and S 12, the front and back 
of the lens L2 are referenced S21 and S22, the front and back of the lens L3 are referenced S31 and 
S32, etc., the front and back of the lens L8 being referenced S81 and S82. 
5 [01041 The a ophGrical aspherical surfaces are determined by means of a surface 

equation of the type: 

z(r) = [(C*rV(l + V" (1- (1+k) *CV) ] + An 2 + A 2 r 4 + A 3 r 6 + A/ + A 5 r 10 
in which: 

"k" is a conicity constant, 
10 "Al", "A2", "A3", "A4", "A5" are constants for adjusting the coefficient of conicity 

according to the position, 

"z" is the shape of the surface, 

V is the radius at the ccntrc center , and 
"C is the radius of curvature. 

15 r01051 The thickness and the diameters are expressed in millimotroo . m illimeters. 

Conicity is a dimensionless quantity, a conicity of "0" designating a circle of revolution, a conicity 
of "-1" designating a parabola of revolution, a conicity between "-1" and "+1" designating an ellipse 
of revolution, a conicity lower than -1 or greater than +1 designating a hyperbola of revolution, the 
coefficients Ai in the surface equation allowing the general shape to be adjusted. 

20 r01061 The diffractive side of the lens L4 is determined by means of a formula of the type: 

<D(r) = pi (r/RO) 2 + (32 (r/RO) 4 

in which: 

V is the distance in relation to the ccntro center of the lens of a point considered, 
located on the surface of the lens, 

25 pl and (32 are constants defining the phase shift of the wave surface, 

"R0" is a constant allowing r to be normalized, and 

,f (p" is the phase shift introduced by the diffractive surface at the point considered. 
r01071 It will be clear to those skilled in the art that the combination of lenses that has just 

been described is only one example of an embodiment allowing a shape close to the rectangular 
30 shape of the image sensor to be obtained. Objective lenses could also be provided using toric lenses 
or bi-toric lenses more complex in shape, such as a torus with a aphcriaal aspherical surface for 
example. In one alternative embodiment, an objective lens according to the present invention can be 
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.produced by means of an indirect-type optical system, that is using mirrors. In particular, a mirror 
of cylindrical or toroidal surface can be used to distort and spread the image on the surface of the 
image sensor. 

r01081 IV - Scope of the present invention - alternative embodiments 

5 r01091 The description above was of a method for capturing a panoramic image by means of 

a fish-eye objective lens and a digital image sensor rectangular in shape, in which the objective lens 
is designed to distort the panoramic image so as to cover a greater number of pixels on the image 
sensor without reducing the field of view. A method for displaying on a screen a sector of a 
panoramic image obtained according to this method was also described, comprising a step of 

10 correcting the distorted panoramic image. This correction step can comprise the correction of the 
image before transferring it into a three-dimensional space, leading to obtaining a classical image 
disk. The correction can also be implicit and be performed at the time an image sector to be 
presented on the screen is projected onto the non-corrected initial image, by using the distribution 
function of the objective lens or a similar mathematical function. 

15 rOHOI It will be clear to those skilled in the art that various alternatives of the present 

invention may be made relating to both the optical properties of the fish-eye objective lens used or 
its arrangement relative to the image sensor, and in the steps of subsequently processing the 
panoramic image obtained. Various applications of the present invention are also possible. In 
addition to applications to photography and to video, the present invention is particularly applicable 

20 to medicine, in endoscopy for example, in which rectangular image sensors are generally used. The 
field angles of the lenses used in these applications are generally lower than 180° and rather in the 
order of 140°. 

[01111 Alternative relating to the relative arrangement of the image sensor and the axes 

XI and X2 of the objective lens 

25 r01121 Fiquro Fig. 13 represents an alternative embodiment of the method according to the 
present invention in which the objective lens and the image sensor are arranged relative to each 
other so that the axis X2 (axis of greater spreading) coincides with a diagonal of the image sensor 
16. This embodiment allows a greater number of pixels of the image sensor to be covered along the 
axis X2. Here, the objective lens has, along the axis XI (axis of lower spreading), a distribution 

30 function F[X1] that compresses the image relative to a classical fish-eye objective lens. This 

embodiment amounts to giving maximum priority to the definition of the image along the axis X2, 

which in practice can correspond to the horizontal axis of a shot. 

r01131 Alternative comprising providing a non-linear fish-eye objective lens 



101141 In one advantageous alternative of the method according to the present invention, an 

objective lens is provided that further has non-linear distribution functions Fd'[Xi] along its axes Xi. 
For a better understanding, Ficrurco Figs. 14A af*d z 14B show the properties of an elliptic 
projection non-linear fish-eye objective lens. Figure Fig. 14A is a graph comprising the relative 
5 distance dr of an image point (relative distance in relation to the cGntrc center of the image) on the 
Y-axis and the field angle a of the corresponding object point on the X-axis. On this graph, the two 
most significant distribution functions of the objective lens are represented, that is the functions 
Fd'[Xl] and Fd'[X2] along the axes XI and X2, and a distribution function Fd'[Xi] along any axis 
Xi. The linear functions Fd[Xl], Fd[X2], Fd[Xi] described above in relation with Fiqurc Fig. 5C 

10 are represented in dotted lines as points of comparison. 

[01151 For field angles lower than an angle al, the functions Fd' [XI], Fd' [X2], Fd' [Xi] each 

have a gradient higher than the gradient Kl, K2, Ki of the corresponding linear function Fd[Xl], 
Fd[X2], Fd[Xi]. That means that the image points corresponding to object points having a field 
angle between 0 and al are projected onto the image sensor with a spreading rate higher than the 

15 constants Kl, K2, Ki and are therefore further apart from each other. For field angles higher than 
the angle al, the functions Fd'[Xl], Fd'[X2], Fd'[Xi] each have a gradient lower than the gradient 
Kl, K2, Ki of the corresponding linear function Fd[Xl], Fd[X2], Fd[Xi]. That means that the image 
points corresponding to object points having a field angle between al and A/2 (A being the angular 
aperture of the objective lens) are closer to each other. 

20 [01161 An image ellipsoid ID3 obtained with this non-linear objective lens is represented in 

Ficrurc F ig. 14B. The image ellipsoid has a central ellipsoidal zone ID3-1 in which the image is 
expanded, and a peripheral zone ID3-2 in which the image is compressed. Thus a combination of 
two technical effects is obtained. The first technical effect is the increase in definition due to the 
spreading of the image along the axis X2. The second technical effect is a further increase in 

25 definition in the central zone ID3-1 of the image, to the detriment of the compressed zone DD3-2 that 
is considered less important. The expanded zone benefits from a high definition as it covers a 
greater number of pixels on the image sensor, while the definition of the compressed zone is lower. 
[01171 In practice, a maximum divergence of at least ±10% compared to a linear distribution 

function is necessary to obtain an image expansion that is substantially advantageous when a digital 

30 zoom is made. "Divergence" means the difference in percentage between the distance in relation to 
the GGntrc center of an image point and the distance in relation to the CGntrc center that would be 
obtained for the same image point if the distribution function were linear. The maximum 
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.divergence is the divergence measured at a point at which the non-linear function is the furthest 
away from the corresponding linear function. If the curve Fd'[X2] on Fiqurc F ig. 14A is 
considered as an example, it can be seen that there is an image point pmax at which the curve 
Fd'[X2] is the furthest away from the linear curve Fd[X2]. By designating by drmax the relative 
5 distance of the point pmax and by drlin the relative distance that this point would have in relation to 
the ccntrG center of the image if the distribution function were linear, the maximum divergence is 
here equal to: 

DIVmax% = [[drmax - drlin]/[drlin]]* 100 
r01181 In practice, producing an objective lens having non-linear distribution functions 

10 Fd'[Xl], Fd'[X2], Fd'[Xi] is within the understanding of those skilled in the art by adding a group 
of lenses forming an apodizer in an objective lens according to the present invention. Apodizers are 
optical systems well known by those skilled in the art, used for example as filters to cover the 
aperture of an optical instrument in order to remove the secondary rings of a diffraction pattern. 
Here, the idea of the present invention is to use an apodizer for a different purpose, that is to control 

15 the angular distribution of a panoramic lens and to obtain the non-linearity sought. 

f01191 In practice, an apodizer can be produced simply by means of one or more a— 

spherical aspherical lenses possibly combined with a diffractive surface. This optical group 
may, for example, comprise a planoconcave lens having a concave and a aphcrioal aspherical 
front, a planoconvex lens having its plane side oriented towards the front, a meniscus having a 

20 concave and a aphcrioal aspherical front and a diffractive, convex back. 

r01201 Obtaining several non-linear functions Fd' [XI], Fd' [X2], Fd' [Xi] a using a non-linear 

function Fd defined by the apodizer A is performed by a group of lenses of the type described above, 
comprising cylindrical lenses for example. 

[01211 Another way of introducing an apodizer into an objective lens of the type described 

25 above is to provide an optical system comprising a plane mirror that reflects the light beam onto a 
distorting mirror of concave, a qpherical aspherical shape, the beam reflected by the distorting 
mirror being sent onto the image sensor. In this embodiment, the irregularities of sphericity that the 
concave part of the mirror has determine the angular distribution function Fd sought for the intended 
application (distortion in the ccntrc center , on the edges-r- r, etc .). 
30 r01221 General i oat ion Generalization of the correction method and of the algorithm 2 
r01231 It must be noted here that modern computer-assisted lens design tools can be used to 

produce any type of objective lens according to the present invention, projecting a panorama in the 
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form of an image of any shape covering more pixels than an image disk, having a linear or non- 
linear distribution function, using direct or indirect optical systems (mirrors). 
r01241 In these conditions, and in anticipation of the different models of objective lenses 

according to the present invention that may be made, it is useful to provide a 
5 general isation generalization of the correction method according to the present invention. 
[01251 Ficmrc F ig. 15 A shows the case in which a fish-eye objective lens according to the 
present invention projects onto an image sensor a distorted image ID4 of any shape which tends to 
be similar to the rectangular shape of the sensor. Several curves J(al), J(a2), J(a3), J(a=90°) can 
be distinguished each consisting of image points corresponding to object points having the same 

10 field angle ocl, a2, oc3, oc=90°. A curve G(\j/i) can also be distinguished that represents the 

projection of a set of object points located along the same axis Xi of angle \|ri, the angle \|/i here 
being measured in relation to one of the two axes of greater spreading X2, X2' that the objective lens 
comprises (these axes, not represented, substantially coincide with the two diagonals of the image 
sensor). It can be seen here that the curve G(\|/i), or projection of the axis Xi onto the image sensor, 

15 is not rectilinear due to physical defects of the lenses naturally leading to this distortion. This 

distortion does not in any way hinder the implementation of the correction method according to the 
present invention and only requires the plurality of distribution functions Fd[Xi](a) of the objective 
lens according to the present invention being quantified at the time of the computer-assisted design 
of the objective lens. This quantification of the functions Fd[Xi] can take the form of a table giving 

20 for each object point defined by angles \|/, a the position of the corresponding image point on the 
distorted image ID4. To save on the memory space of the microcomputer in charge of displaying 
the image ID4 (in the form of an interactive image sector sliding tangentially to a sphere portion), 
the table can be sampled by removing a certain number of object points. The distribution function 
Fd[\j/i](cti) for each object point removed can then be calculated by interpolating the distribution 

25 functions of the adjacent object points. 

f01261 With reference to Fiqurc F ig. 15B, a point P(px,py,pz) will be considered as an 

example that is the projection onto a sphere portion HS of an image point E(i,j) of an image sector to 
be presented on a screen (not represented here). The point P(px,py,pz) has determined 
angles \|/ and a. The angle \|/ is the angle that a point "m" that is the projection of the point 

30 P(px,py,pz) in the plane OXY has relative to the axis OX. The angle a is the angle in relation to the 
axis OZ that a segment of straight line L passing through the point P(px,py,pz) and through the 
ccntrc center O of the sphere portion HS has. As explained above, the point P(px,py,pz) is the 
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.equivalent of an object point of the panorama photographed, the contrc center O of the sphere 
portion HS is the equivalent of the ccntrc center of the panorama photographed, the segment of 
straight line L is the equivalent of an incident light ray, the axis OZ represents the optical axis of the 
objective lens and the angle a represents the field angle of the object point P(px,py,pz). 
5 f01271 It is then considered that the angles a and \j/ are between the following angles: 

\jri<\|/<\|/i+l 

ccj<a<aj+l 

and that the distribution functions of the objective lens have been quantified for the angles ai, ai+1, 
\|/i, \|/i+l, for example in a table Tl partially described below. 
10 r01281 The coordinates (pu,pv) of a point F(pu,pv) that is the projection of the point 

P(px,py,pz) onto the distorted image ID4, are easy to calculate by interpolation, such as an 
interpolation on four values for example: 

pu = [(pu)i,j + (pu)i+lj + (pu)ij+l +(pu)i+l,j+l]/4 
pv =[(pv)i,j + (pv)i+l,j + (pv)ij+l +(pv)i+l,j+l]/4 

15 r01291 Table Tl 
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r01301 Thus, the algorithm 2 described above can be generalised by replacing the lines 16 to 

19 by the following steps: 

[search for the angle \|/] 

20 If px>0 then 

\|/ = arc cos(px/V(px 2 +py 2 )) 
if not if px<0 

\|/ = -arc cos(px/V(px 2 +py 2 )) 
if not if px=0 and py>0 then 
25 \|/ = 7i/2 

if not if px=0 and py<0 then 
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y = -nil 

if not 

\|/ = 0 

End if 

pu = L2*Fd[\|/](a)(l) 
pv = L2*Fd[\|/](a)(2) 

[01311 In these steps, Fd[\j/](a)(l) designates the coordinate "pu M of a point P'(pu,pv) 

corresponding to the projection onto the image ID4 of a point P(px,py,pz) belonging to the 
hemisphere HS, the point P being itself the projection of a point E(i,j) belonging to the image sector 
to be displayed (not represented in Ficrurc F ig. 15B). Similarly, Fd[\|/] (a)(2) designates the 
coordinate "pv" of the point P'(pu,pv). 

[01321 Therefore, the algorithm 2 is genera liocd generalized to any type of objective 

lens within the meaning of the present invention. In the case of a linear elliptic image, the function 
Fd[\|/](cc) can be expressed in the following mathematical form and does not require drawing up a 
quantification table: 

Fd [\|/] (a) = [cos 0|/) *2* (7i/a) * (L1/L2) ; sin (\|/) *2* (7i/a) ] 
[01331 The example that has just been described shows that an objective lens according to 

the present invention can have several axes of greater spreading (X2, X2'). This example also shows 
that the a^ eaxis or axes of greater spreading are not necessarily perpendicular to the axis XI of 
lower spreading. 
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101341 APPENDIX (forming an integral part of the description) 
r01351 Table 1 

51 - Acquisition 

- Capturing a panoramic image by means of a still digital camera or a digital video camera 
equipped with a fish-eye objective lens according to the present invention 

=> Obtaining an image ellipsoid (Dl, D2) 

52 - Transfer of the image file into a computer 

- Transfer of the image file of the image ellipsoid into a microcomputer, 

- Storage in the auxiliary storage (optional) 

53 - Correction of the image ellipsoid 

- Transfer of the image points of the image ellipsoid into a virtual image disk of radius D2 
comprising more image points than an image disk of radius Dl, 

=> Obtaining a classical image disk 



S4 - Digit i s at io nD igitization 

- Transfer of the image points of the image disk into a system of axes OXYZ in spherical 
coordinates 

=> Obtaining a hemispherical panoramic image 



S5 - Interactive display 

- Determination of the image points of an image sector to be displayed 

- Display of the image sector on a display window 

- Detection of the user's actions on a screen pointer or any other control means, 

- Detection of the user's actions on keys for image enlargement, 

- Modification of the sector displayed (sliding the image sector displayed on the surface of 
the hemisphere and/or shrinking/expanding the image sector displayed) 
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101361 Table 2 



51 - Acquisition 

- Capturing a panoramic image by means of a still digital camera or a digital video camera 
equipped with a fish-eye objective lens according to the present invention 

=> Obtaining an image ellipsoid 

52 - Transfer of the image file into a computer 

- Transfer of the image file of the image ellipsoid into a microcomputer, 

- Storage in the auxiliary storage (optional) 

S3* - Interactive display with implicit correction of the distortions of the initial image 
A - Determination of the colour color of the points E(i, j) of an image sector using the 
points P'(pu, pv) of the image ellipsoid: 

1- Determination of the coordinates Ex, Ey, Ez in the coordinate system OXYZ of each 
point E(i, j) of the image sector, 

2- Determination of the coordinates px, py, pz of points P(px,py,pz) corresponding to the 
points E(i, j) projected onto a hemisphere, 

3- by means of the distribution function Fd of the objective lens, determination of the 
coordinates, in the coordinate system O'UV of the image ellipsoid, of the points P'(pu, pv) 
corresponding to the projection of the points P(px,py,pz) on the image ellipsoid, 

B - Presentation of the image sector in a display window 

C - Detection of the user's actions on a screen pointer or any other control means 
D - Detection of the user's actions on enlargement keys 

E - Modification of the image sector displayed (moving and/or shrinking/expanding the 
image sector) 
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rQ1371 Table 3 



Surfaces 


Type 


Comment 


Radius of 
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13 


0 
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SPHERICAL 




-19.34 
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A— 
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-34.68 


14.69 
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0.0858 
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SPHERICAL 




-26.35 


0.45 




25.4 


0 
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SPHERICAL 




Infinite 


5.2 
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25.4 


0 


S71 
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Infinite 


3 




20 


0 
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SPHERICAL 




Infinite 


3.1 


BK7 


20 


0 
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SPHERICAL 
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8 




16 


0 
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Infinite 


2 


BK7 


16 


0 
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CLAIMS 

We claim: 

L A method for capturi ng a digit al panoramic image comprising: 

3^ — Method for capturing a digital panoramic — image , — comprising 

5 a atop of p rojecting a panorama ( PM) — onto an image sensor — (16) by means of a fish-eye 
objective lens having a constant field angle relative to its optical axis, the image sensor being 
rectangular in shape, 

— characterised in that t he fish-eye objective lens (15 , — 3-9-) — i^being 
provided to project onto the image senso r (16) , without reducing the field of view, a distorted 
10 panoramic image (IDl, ID3) which is not in the shape of a disk and which covers a number of 
pixels on the image sensor higher than the number of pixels that would be covered by a conventional 
image dis k ( 4 ) . 

2. 2 . Method T he method according to claim 1, wherein the fish-eye objective lens 
has an image point distribution function (Fd[Xi], Fd' [Xij ) that varies according to axes 
15 -fXi-f— perpendicular to the optical axis (OZ) of the objective lens, and which has a minimum 
spreading rate of the image along a first axis (XI) — perpendicular to the optical axis— and a 
maximum spreading rate of the image along at least a second axis -fX2-)— perpendicular to the 
optical axis, such that the image projected onto the image sensor is expanded along the second axis 
(X2) . A 

20 3. 3 . Method T he method according to claim 2, wherein the first (XI) and the 

second (X2) axes of the objective lens are perpendicular and the image (IDl) projected by the 
objective lens onto the image sensor is ellipsoidal in shape. 

4. 4 > Method T he method according to claim 3, wherein the image sensor (16) — is 
arranged relative to the first and second axes of the objective lens so that the major axis (D2) of 

25 the ellipsoidal image (IDl) coincides with an effective length (Ld) of the image sensor. 

5. 5 . Method T he method according to claim 3, wherein the image sensor (16) is 
arranged relative to the first and second axes of the objective lens so that the major axis (X2) of 
the ellipsoidal image coincides with a diagonal of the image sensor. 

6. 6. Method T he method according to one of claimo 2 to 5, claim 2, 

30 wherein the objective lens has a distribution function (Fd ; [Xi] ) that is not linear and that has a 
maximum divergence of at least ±10% compared to a linear distribution function (Fd[Xi] ) , such 
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.that the projected image ( ID3 ) has at least one substantially expanded zone (ID3 1) and at 
least one substantially compressed zone (ID3 2) , 

7. 7 . Mcthod T he method according to one of claimo 1 to 6, claim 1, 
wherein the fish-eye objective lens comprises a combination of a group of lenses (Ll L6) 
5 provided to capture a panoramic image according to a determined field angle- and— e# at least one 
cylindrical lens (L7, L8) having an axis of revolution perpendicular to the optical axis of the 
objective lens. 

8^ 8 . Mothod A method for displaying on a screen (23) an initial panoramic 
image (ID1) captured in accordance with the method according to one of claimo 1 to 7, 
10 characterised in that it comprises a otcp of correcting — (-S3-; — S3 ' ) 
the distortions of the initial image . claim 1, the method comprising: 

correcting the distortions of the initial image. 

9. — 9-r -The Method according to claim 8, wherein the correction step (S3 ) — comprises 
transforming the initial image into a corrected digital image (ID2 ) — in the shape of a disk, the 

15 diameter of the corrected image being chosen so that the corrected image comprises a number of 
image points higher than the number of pixels of the image sensor covered by the initial image. 

10. 1 0 ; Mcthod T he method according to claim 9, wherein the initial image (ID1) 
is ellipsoidal in shape and the corrected image ( ID2 ) has a diamete r (D3) the size in number of 
pixels of which is at least equal to the size in number of pixels of the major axis (D2 ) — of the initial 

20 ellipsoidal image ( IDl ) . 

11. The method according to claim 8, further comprising: 

11, Method according to claim 8, comprising a step of 

projecting^ onto the initial image (IDl) , image points ( E ( i , j ) ) of an image sector (IS) t o 
be presented on the screen (23) , 
25 allowing the colours colors of the image points of the image sector to be presented on 

the screen to be determined, 

wherein the step of projecting the image points (E (i, j ) ) — of the image secto r (IS) 
onto the initial image (IDl) — bcing is performed by means of a distribution function (Fd) 
representative of the optical properties of the fish-eye objective lens, such that the step of correcting 
30 (S3 ' ) the distortions of the initial image is implicit in the projection step. 

12. 12 . Mctho dT he method according to claim 11, wherein the projection step 
comprises a first step of projecting the image points ( E ( i , j ) ) of the image sector (IS) onto a 
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.sphere portion (HS) , and a second step of projecting, onto the initial image ( IDl ) , the image 
points ( P ( px , py , pz ) ) projected onto the sphere portion. 

13. 13 . Computer A computer program product recorded on a medium (25) — and 
loadable into the memory of a digital computer — (22) , — oharactcriocd in that it 

5 containa , the computer program code a eon taining code executable by the computer - that is 
arranged to execute the steps of the display method according to one of claimo 8 to 
4^-r claim 8. 

14. 14. Fish A fish -eve objective lens having a constant field angle relative to its 
optical axis and comprising optical means (Ll L8) f or projecting the image of a panorama (PM) 

10 onto an image senso r (16) , — characterised in that it , the fish-eye objective lens 
comprises optical means (L6 L7) for projecting, without reducing the field of view, a distorted 
image ( IDl , — ID3 ) that is not in the shape of a disk and which covers a number of pixels on an 
image sensor higher than the number of pixels that would be covered by a conventional image disk 

15 15,. 15 . Obi ectivo T he fish-eve objective lens according to claim 14, having an 

image point distribution function (Fd[Xi] , Fd' [Xi] ) that varies according to axes (Xi) 
perpendicular to the optical axis (OZ) of the objective lens, and which has a minimum spreading 
rate of the image along a first axis (XI) p erpendicular to the optical axis— and a maximum 
spreading rate of the image along at least a second axis 4X3-)— perpendicular to the optical axis, 

20 such that an image delivered by the objective lens is expanded along the second axis (X2) . 

16. 16. Obi cc tivc T he fish-eve objective lens according to claim 15, having a 
distribution function (Fd' [Xi] ) t hat is not linear and that has a maximum divergence of at least 
±10% compared to a linear distribution function — (Fd[Xi] ) , such that an image (ID3 ) — delivered 

- by the objective lens has at least one substantially expanded zone ( ID3 1 ) and at least one 
25 substantially compressed zone — (ID3 2) . 

17. 17 . Obi cctivc T he fish-eve objective lens according to one of claimo 14 
to 16, claim 14, comprising a combination of a group of lenses (Ll L6) p rovided to capture a 
panoramic image according to a determined field angle- and— e# at least one cylindrical lens (L7 , 
ir8-} — having an axis of revolution perpendicular to the optical axis of the objective lens. 

30 18. 18 . Obi cctivc T he fish-eve objective lens according to one of claimo 1 4 

to 17, c laim 14, comprising optical means forming an apodizer. 

19. 10 . Obi cctivc The fish-eve objective lens according to claim 18, wherein the 
optical means forming an apodizer comprise at least one a oiohcrical aspherical lens. 
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20. 2 0 . Obi cct ivc T he fish-eve objective lens according to one of claims 1 4 
to 10, claim 14, comprising at least one distorting mirror. 

21 . 21 . — Obi cctivc T he fish-eye objective lens according to one of 
claima 14 to 20, — characterised in that it io of thc claim 14, wherein the 
lens is a panoramic adapter typc lens and is provided to be placed in front of a still camera non- 
panoramic objective lens. 

METHOD FOR CAPTURING A PANORAMIC IMAGE DY MEANS OF AN IMAGE SENSOR 

RECTANGULAR IN SHAPE 
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ABSTRAC T OF THE DISCLOSURE 
The present invention relates to a A method for capturing a digital 
panoramic image, teyincludes projecting a panorama onto an image sensor by means of a fish-eye 
objective lens having a constant field angle relative to its optical axis-; — fcfe e. The image sensor 
bcing is rectangular in shape. According to the present invention, — fefe e The fish- 
eye objective lens is provided to project onto the image sensor, without reducing the field of view, a 
distorted panoramic image ( IDl ) that covers a number of pixels on the image sensor higher than 
the number of pixels that would be covered by an image disk. Advantages! — improvement 
in the definition in a useful zone of the imago , — particularly to 
improve the quality of digital zooms. 

Fig. 7A 
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